Noise-induced dynamics in bistable systems with delay 
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Noise-induced dynamics of a prototypical bistable system with delayed feedback is studied theo- 
retically and numerically. For small noise and magnitude of the feedback, the problem is reduced to 
the analysis of the two-state model with transition rates depending on the earlier state of the system. 
In this two-state approximation, we found analytical formulae for the autocorrelation function, the 
power spectrum, and the linear response to a periodic perturbation. They show very good agree- 
ment with direct numerical simulations of the original Langevin equation. The power spectrum has 
a pronounced peak at the frequency corresponding to the inverse delay time, whose amplitude has 
a maximum at a certain noise level, thus demonstrating coherence resonance. The linear response 
to the external periodic force also has maxima at the frequencies corresponding to the inverse delay 
time and its harmonics. 



PACS numbers: 05.40.-a, 02.50.Ey 

The effects of random noise on bistable systems and 
the related phenomenon of stochastic resonance have re- 
ceived an enormous attention in the last decade. As a 
result, a comprehensive theory and a whole range of ex- 
perimental observations have emerged (for a recent re- 
view see ||l|). In many physical as well as biological sys- 
tems, the time-delayed feedback plays a significant role 
in the dynamics. These systems in the absence of noise 
have been well thoroughly investigated using the theory 
of delay-differential equations (DDE) g . The theory of 
stochastic delay-differential equations (SDDE), in which 
effects of noise and time delay are combined, remains 
much less studied. Meanwhile, it appears that the com- 
bination of these features is ubiquitous in nature as well 
as in society. Examples include biophysiological dynam- 
ics pi and laser dynamics in optical cavities [0. It is 
also believed that the combined effects of noise, bistabil- 
ity, and delay play an important role in gene regulatory 
networks [^. 

The delayed stochastic systems have been a subject of 
several recent papers [g, 0, §|- In Refs. Q, a system- 
atic statistical description of a certain class of stochastic 
delay-differential equations was developed in the limit of 
small time delay. More interesting, however, is the case 
of a large time delay which is comparable with the mean 
Kramers transition time determined by the noise inten- 
sity and the potential barrier height. In this case, reso- 
nant phenomena may occur which would lead to sponta- 
neous oscillations of the system with a certain preferred 
frequency. In Refs. |^], Ohira and co-workers studied the 
related phenomenon of delayed random walks. In that 
model, the hopping probability depends on the position 
of the particle a given number of hops in the past. In cer- 
tain cases, the particle diffusion is limited, and it exhibits 
quasi-regular oscillations near the origin. In Ref. Q, 
Ohira and Sato studied a discrete-time two-state system 



in which the occupancy probabilities of the two states 
depended on the state of the system some N time steps 
before. While that model also showed some interesting 
resonant features, it appears to us somewhat unrealistic, 
since the states of the system at two consecutive itera- 
tions are completely uncoupled, and its dynamics is in 
fact identical to that of a superposition of TV indepen- 
dent one-dimensional maps affected by random noise. In 
most practically relevant cases, however, the state of the 
system should be affected in the first place by its im- 
mediate past, with additional correction arising from the 
time-delayed feedback. 

In this Letter we study the effects of the thermal 
activation on bistable systems with additional time- 
delayed feedback. Our prototypical model is the over- 
damped particle motion in the double- well quartic poten- 
tial U(x{t), x{t — T)), described by the Langevin equation 



dxjt) _ dU(x{t),x{t~T)) 
dt ^ dx{t) 

= x{t) -x^{t)+ex{t-T) + - 



(1) 



Here T is the delay and e is the strength of the feedback, 
and ^(i) is a Gaussian white noise with (^) = and 

{m^{t')) = 5{t-t'). 

In our analytic description we approximate d3) with a 
two-state (dichotomic) system, in which the dynamical 
variable s{t) takes two values s = ±1. This reduction 
has been successfully used in studies of the stochastic 
resonance [bI. The dynamics of s is fully determined by 
the switching rates, i.e. by the probabilities to switch 
s — > —s. Because of the delay, we have two switching 
rates depending on the state s{t — T): pi if the state at 
time t — T is the same as at time t, and p2 otherwise. 



Thus, the the switching rate can be written as 



P(t) 



Pi +P2 , Pi - P2 



s{t)s{t-T) 



(2) 



A quantitative relation between the rate process (0) and 
the original model Im) can be easily established for small 
D and e by virtue of the Kramers formula for the escape 
rate r^ = (2^)- Vt^"(a;™)t^"(^o) exp[-AC//Z?], 
where Xm and xq are the positions of the minimum 
and the maximum of the potential, respectively, and 
At/ is the potential barrier to cross over. For small D, 
the switching rates are small compared to the intra-well 
equilibration rate, and the probability density distribu- 
tion is close to a narrow Gaussian distribution centered 
around Xm, and so the adiabatic approximation applies. 
For small e, \xm\ = 1 ± e/2 depending on the sign of 
x(t)x{t — T),xo — 0, and in the first order in e we obtain 



Pl,2 



V2±jk 
2^ 



■ exp 



l±4e 

4:D 



(3) 



Without loss of generality let us assume that the sys- 
tem is at state s = 1 at time 0. We define n±{t) to be the 
probability of attaining value ±1 at time t. The master 
equations for n±{t) is written in a usual way. 



n+{t)^~W^{t)n+{t) + W^(t)n^(t), 



(4) 



where W] (t) dt is the probability of transition from — 1 
to -|-1 within time interval (i,t -I- dt) and vice versa. In 
our stochastic model with time-delayed feedback. 



W^{t)^p^n+{t - T)+p2n_{t - T) 
W^{t)=p2n+{t - T)+pin-{t - T) 



(5) 



Substituting (H) in (0) and making use of the normaliza- 
tion condition n_{t) + ?T.+ (t) = 1, we obtain 

n+{t) ^p2n^{t) -pin+{t) - {p2 - _pi)n_(i - T), (6) 
n-{t) = -pin^{t) +p2n+{t) - {p2 ~pi)n+{t-T). (7) 

The correlation function C{t) is determined as 

C(r) = (.(r).(O)) = {sir)) = n+(r) - n_(r), (8) 

(we recall that the initial state is s(0) ~ 1). Thus, re- 
placing t with T and subtracting ([^) from (|6|), we obtain 



dCJT) 
dr 



-iPl+P2)C{T) + (p2-pi)C{T-T). (9) 



This equation should be complemented with the sym- 
metry C{—t) = C{t) and the normalization C(0) = 1 
conditions. 

The solution of this linear equation on the interval 
(0, T) can be found using ansatz C{t) — Aexp(— At) + 
i3expA(T — T). Plugging this ansatz in Eq.(||) 
yields A == 2^PiP2, B = A{^ - ^)/{^ + 



.y/pT) exp(— 2y^pip2T). Constant A is found from the con- 
dition C(0) = 1, and we obtain 



C{t) = 



( ypT + VP^)e-^" + (yp^ - vpr) e 

^/Pi + VP2 + (VP2 - V^)e" 



X{T-T) 



-XT 



Using (|^) and (pX|), one can easily calculate C{t) at all 
T>T, 

C{nT + r') = e-(Pi+''=)^'C(nr) + (p2 - Pi) x 

X / C((n-l)T + i)e(Pi+P^)(*-^')di, (11) 



where n = 1, 2, ... and < t' < T. 




(P2-Pi)T 



FIG. 1: The autocorrelation function in the two-state model 
as a function of the time lag r and the feedback strength 
P2 -pi, for (pi +P2)T = 10. 



We present correlation function (|10|) , (|ll|) as a function 
of normalized time t /T and dimcnsionless parameters 
Pi^2T in Fig. m. Its structure differs depending on whether 
the feedback is positive (p2 > pi, what corresponds to a 
positive e in (|l|)), or negative (p2 < pi, e < 0). For posi- 
tive feedback the correlation function is positive, and has 
maxima at r « nT. For negative feedback the peaks at 
T « nT have alternating signs. It is interesting to note 
that the peaks of the correlation function are always de- 
layed with respect to nT. For AT ^ 1, the time interval 
corresponding to the first peak is 



Ti=T+ (^ - y/pT) ^ In 



iVm + yp^)^ 

2(P1+P2) 



(12) 



From the correlation function we can also determine 
the power spectrum S{lu) — J_ C{t) cos{ujt) dr. It is 
convenient to derive the expression for S directly from 
equation ^). Denoting L{lj) = J^ C{t) exp[iujT] dr and 
substituting here (H) we obtain 



-C{0)-iujL 
where 



-{pi+P2)L + ip2-pi)e'^' [L~I{lo)] 



(13) 



liu) 



C{T)e- 



'dT = 



(\/pr+ V^)[l - e(-*"-^)^](zc^ + A)-i + ( 



Jh)[e 



-XT 



]iiLU-X)-^ 



Pi + ^/P2 + (^/P2 - y/Pi)e' 



r 



-AT 



Using C(0) = 1 and S{u!) = 2ReL(a;), we obtain 
1 + (P2-Pi)e'"^/M 



5(cj) = 2Re 



P1+P2- {P2 - pOe'""^ - iuj 



(14) 



We compare this analytic result with numerical simu- 
lations of the bistable oscillator (|^) in Fig. g. 
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FIG. 2: Comparison of the power spectrum in Eq. (hi) for 
D = 0.1, r = 250, e = 0.05 (solid line) with theory (0) 
(dashed line). 
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FIG. 3: Power spectrum in the delay system (|l|) calculated in 
the two-state approximation for T — 250 and e = 0.1. 

In figure || we show the dependence of the power spec- 
trum on the noise intensity D, while the feedback param- 
eter e is kept constant (the switching rates pi^2 are calcu- 
lated according to (ph). One can see that the peak at the 
main frequency uj « 271 /T has a maximum at a certain 
noise level. This is a characteristic feature of the coher- 
ence resonance Ifllll: the coherence in the noise-driven 



system attains maximum at a "resonant" noise tempera- 
ture. In the present case the underlying physical mecha- 
nism is the resonance between the Kramers rate and the 
delay. If the Kramers rate is small (for small noise in- 
tensity), a characteristic interval between the switches is 
larger than delay time, and the latter is not displayed in 
the spectrum because the process is a purely Poissonian 
one (with a renormalized due to the feedback switching 
rate). For an intermediate Kramers rate the switchings 
are highly influenced by the feedback, with a preferable 
periodicity with the delay time T being manifested as a 
peak in the spectrum. For large noise intensity the ef- 
fect of the feedback decreases again, because the relative 
magnitude of the delayed feedback {p2 ~ Pi)/ipi +P2) is 
proportional to D~^. 

Let us discuss now the response of the time-delay 
stochastic system to a periodic external force. Similarly 
to Ref. Ipl, we assume that the transition rates (0) are 
modulated with a frequency fl according to the Arrhe- 
nius rate law, 

W^it) = [pin+(i~T)-fp2n-(t-T)]e^«, 

where j{t) = fiD^^ cos{ilt + (p). The equation for the 
quantity a{t) = n+{t) — n_(i) (which now is not the 
autocorrelation function) now reads 



^ = -(pi+P2)(n+e^(*) 



-7(t)^ 



+ ip2 - pi)(n+eT(*) + 7i_e-T(*))a(t ~ T) . 



In the linear approximation ^ << 1 this reduces to 
da 



dt 



-iPi+P2Ka+iit))+iP2-Pi)<y{t^T)ii+c{th{t)) 



Now writing a = ao + ^D ^cti where ctq is the solution 
(n^,0), we obtain for the first-order correction cti 



-{pi +P2)<yi + {P2 - Pi)(^iit - T) 



da I 

~dr 

+ ((P2 - Pi)ao{t)ao{t -T)- [pi + pa)) cos(f]< + (;^J5) 

We are interested in the response at the frequency fi 
for t ^ 00, because only this part contributes to the 
delta-peak in the spectrum at this frequency. For t — > 00 
o'o(^) -^ 0, so we can neglect the corresponding term 
{P2 ^ Pi)i^vi{t)ai^{t — T) in (nSl) and write the solution as 



(71 (t) =Re 



(Pi -^^2)6'"*+"^ 



iP2 



Pije 



-iSlT 



iQ- (pi -I-P2) 



This is exactly the periodic component at frequency fi in 
the process s{t), and the hnear response rj is 



1 



V 



{Pl+P2f 



2D^ 



\iP2 



Pi)e 



-iflT 



in~ {pi +P2)r 



(16) 



In the absence of delayed feedback, when pi = P2 = tk, 
this expression coincides with that of for the stochas- 
tic resonance in the two-state model. With feedback, the 
response demonstrates a resonance-like structure in de- 
pendence on the driving frequency (contrary to the clas- 
sical stochastic resonance), see Fig. 0. 
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the mean switching time comparable to the delay time. 
The linear response to the external periodic force also has 
maxima at the frequencies corresponding to the inverse 
delay time and its harmonics. 

In a more general context of multistable dynamical sys- 
tems with memory, the behavior of the system depends 
on its past through some memory kernel. Such a kernel 
is equivalent to multiple time delays. A similar analy- 
sis of the correlation properties for such systems would 
be of great interest. Furthermore, in applications, mul- 
tiple feedback loops with different delay times occur in 
networks of interacting elements, such as biological neu- 
rons, stock traders, or Internet nodes. It is very inter- 
esting to study the influence of noise on the dynamics of 
such networks. We anticipate the emergence of sponta- 
neous oscillations and the coherence resonance features 
similar to the effects considered in this Letter. 
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FIG. 4: Linear response of model (|l|) for D = 0.1, T = 250, 
e = 0.05, normalized by the variance of the process (circles), 
compared with theory (hffl (line) 

In conclusion, we have developed a theory of a noise- 
driven bistable system with delayed feedback. In gen- 
eral, this problem is very difficult because of the non- 
Markovian nature of the dynamics. However, for small 
noise and small magnitude of the feedback, the problem 
can be greatly simplified by reduction to the two-state 
(dichotomic) model with certain transition rates which 
depend on the earlier state of the system. In this two- 
state approximation, we were able to derive the analyti- 
cal formulae for the autocorrelation function, the power 
spectrum, and the linear response to a periodic pertur- 
bation. They show very good agreement with direct nu- 
merical simulations of the corresponding Langevin equa- 
tion. The power spectrum has a pronounced peak at the 
frequency corresponding to the delay time, whose ampli- 
tude has a maximum at a certain noise level, thus demon- 
strating coherence resonance. This level corresponds to 
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